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Advertisement Delivery For Streaming Program 

BACKGROUND OF THE INVENTION 

5 

1. Field of the Invention 

The present invention relates to the field of data processing. More 
specifically, the present invention relates to the rendering of advertisements for 
streaming programs. 

10 

2. Background Information 

With advances in integrated circuit and microprocessor, processor based 
computing devices are increasingly more powerful in terms of their processing 
capabilities. Processing power that was once available only in the most expensive 

15 mainframe systems are now available in even many entry level hand held consumer 
devcies. As a result, increasing, processing intensive rich multi-media contents are 
being made available and consumed on even the most basic ones of these 
processor based computing devices. 

Concurrently, advances in networking and communication technologies have 

20 resulted in increasing number of these processor based computing devices being 
networked together. Such devices are often first coupled with a local area network, 
such as an Ethernet-based office/home network. In turn, the local area networks 
are interconnected together through wide area networks. Of particular importance is 
the global inter-network, the Internet. As a result of this trend of increased 

25 connectivity, an increasing amount of these rich multi-media contents are made 
available, distributed, or broadcast online. 
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Online broadcasting invloves the continuous streaming of programmed 
content from broadcasting servers to networked client systems for consumption. 
Streamed programming, as its brethren of the earlier generation, i.e. broadcast 
programming over air waves or cable network, typically contains advertisements at 
periodic advertisement time slots. In fact, for many content broadcasters, such as 
radio or television programming, for efficiency reasons, the streamed programming 
is the exact mirror image of the programming broadcast over the air waves or cable 
network, thus containing the same advertisements at the corresponding 
advertisement time slots. 

Accordingly, a number of problems or undesirable characteristics arise. First, 
by operation of law, or contractual obligations, it is at times inappropriate for the 
broadcasters to repeat rendering of the same advertisements in the streamed 
programming. However, re-processing or regeneration of the programming without 
or with different advertisemens for streaming is a costly solution. Further, even if it 
is not inappropriate to re-broadcast the same advertisements in streamed programs, 
a number of these advertisements are not the most suitable advertisements, given 
the different delivery medium, as well as different consuming audience. Moreover, 
replacing the on-air advertisements with other advertisements targeted for the 
streaming medium presents the broadcasters with opportunities to collect additional 
revenues for the same advertisement time slots. 

Thus, an advertisement delivery approach that can overcome, at least 
partially, these problems/undesirable characteristics, and/or being able to exploit the 
capabilities of the new delivery medium is desired. 
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BRIEF DESCRIPTION OF DRAWINGS 

The present invention will be described by way of exemplary embodiments, 
5 but not limitations, illustrated in the accompanying drawings in which like references 
denote similar elements, and in which: 

Figure 1 illustrates an overview of the present invention, in accordance with 
one embodiment; 

Figure 2 illustrates the method of the present invention, in accordance with 
10 one embodiment; 

Figure 3 illustrates the operations associated with pre-caching 
advertisements in further detail, in accordance with one embodiment; and 

Figure 4 illustrates an internal component view of a digital system suitable for 
use to practice the present invention, in accordance with one embodiment. 

15 
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DETAILED DESCRIPTION OF THE INVENTION 

The present invention includes a novel advertisement delivery scheme for 
streaming programs. The scheme advantageously enables a content broadcaster to 
efficiently replace advertisements, if any, included in a streaming program, thereby 
enabling the broadcasters to be able to efficiently reuse the same programming 
designed for broadcast in the traditional medium, i.e. airwaves or cable network. 
Moreover, the present invention, as will be readily apparent from the description to 
follow, advantageously enables the advertisements to be more tailored for the 
consumers of the streamed programming, as well as the advertisers to be able to 
more closely monitor the rendering and consumption of their advertisements, and in 
turn, to be more effective in gauging the effectiveness of advertisement campaigns. 

In the description to follow, various aspects of the present invention will be 
described, and specific configurations will be set forth. However, the present 
invention may be practiced with only some or all aspects, and/or without some of 
these specific details. In other instances, well-known features are omitted or 
simplified in order not to obscure the present invention. 

The description will be presented in terms of operations performed by a 
processor based device, using terms such as multi-media contents, requesting, 
downloading, rendering, and the like, consistent with the manner commonly 
employed by those skilled in the art to convey the substance of their work to others 
skilled in the art. As well understood by those skilled in the art, the quantities take the 
form of electrical, magnetic, or optical signals capable of being stored, transferred, 
combined, and otherwise manipulated through mechanical, electrical and/or optical 
components of the processor based device. 
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Moreover, the term "processor" includes microprocessors, micro-controllers, 
digital signal processors, and the like, that are standalone, adjunct or embedded. 
Further, the term "processor based computing devices" (hereinafter, simply 
computing device) includes but is not limited to wireless mobile phones, palm sized 
personal digital assistants, notebook computers, desktop computers, set-top boxes, 
game consoles, servers, and so forth. The term "advertisement" includes 
commerical, public interest and filler messages of all form and all media types, and 
the term "advertisement time slots" includes programming breaks or interruptions of 
all time durations for the purpose of rendering "advertisements". The term "caching" 
refers to the act of storing data coupled with a pre-determined and/or configurable 
policy for displacing prior stored contents to make room for new contents, in the 
event the allocated storage for storing such contents have become fully utilized. 
The term "rendering" refers to the process of physically manifesting content for the 
consumption and/or enjoyment by a user, including but not necessarily limited to 
visual and/or audible manifestation. 

Various operations will be described as multiple discrete steps in turn, in a 
manner that is most helpful in understanding the present invention, however, the 
order of description should not be construed as to imply that these operations are 
necessarily order dependent. In particular, these operations need not be performed 
in the order of presentation. 

The description repeatedly uses the phrase "in one embodiment", which 
ordinarily does not refer to the same embodiment, although it may. The terms 
"comprising", "including", "having", and the like, as used in the present application, are 
synonymous. 
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Overview 

Referring now to Figure 1, wherein a block diagram illustrating an overview of 
the present invention, in accordance with one embodiment, is shown. As illustrated, 
for the embodiment, consumer client systems 102 of streaming content or 
programming, in addition to conventional streaming program player 104 are 
individually provided with advertisement module 106 incorporated with the teachings 
of the present invention. Further, client systems 102 are communicatively coupled 
with streaming program broadcaster 108 and advertisement publisher/server 110. 

Streaming program player 104 performs its conventional function of receiving 
and rendering streaming content or programs from streaming program broadcaster 
108. For the embodiment, it is assumed that in conjunction with the streaming 
content or program, broadcaster 108 also provides a companion stream of event 
notifications. Included among the event notifications, of particular interest, are event 
notifications associated with the occurrences of advertisement time slots, including 
the time length or duration of each of these advertisement time slots. 

As will be described in more detail below, advertisement module 106 
incorporated with the teachings of the present invention, advantageously renders an 
appropriate amount of pre-cached advertisements in each of these advertisement 
time slots, enabling any advertisements included with the streaming content or 
program to be replaced. Moreover, by tailoring the type of advertisements pre- 
cached from advertisement publisher/server 110, the replacement advertisements 
may also be advantageously more targeted for the individual consumers of the 
various client systems 102. 

Further, as will be also described in more detail below, in one embodiment, 
pre-caching of the advertisements from advertisement publisher/server 110 are 
adaptively performed, even while the receipt of the streaming content or program are 
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in progress, to maintain availability of the substitute or replacement advertisements. 
The adaptive manner of downloading the advertisements substantially ensures that 
interference to the delivery of the streaming content or program is insignificant or 
inconsequential. As a result, a compelling advertisement replacement mechanism 
may nevertheless be effectuated even under a very limited or small bandwidth 
network connection. 

Streaming content or a streaming program may be any such single or multi- 
media content or program known in the art or developed in the future, including but 
are not limited to streaming radio and/or television programming over the internet, an 
intranet, cable, radio waves or any telephony system. An example of streaming 
program player 104 is the Real One Player, available from Real Networks, Inc., of 
Seattle, WA. 

Client system 102 represents a broad range of digital systems known in the 
art, including but are not limited to devices such as wireless mobile phones, palm 
sized personal digital assistants, notebook computers, desktop computers, set-top 
boxes, and game consoles. 

Streaming program broadcaster may be any one of a number of public and/or 
private streaming program broadcasters known in the art. An example of a public 
streaming program broadcaster is Real Networks, Inc. Another example of a program 
broadcaster is a radio station like WSTRFM of Atlanta, GA. An example of a private 
streaming program broadcaster is a large enterprise streaming private contents or 
programs to a number of its geographically dispersed private audience. 

Advertisement publisher/server 110 may be any one or more of these entities 
known in the art. An example of an advertisement publisher is Doubleclick of New 
York, NY. 
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In a preferred embodiment, client systems 102, streaming program 
broadcaster 108 and advertisement publisher/server 110 are coupled with each other 
over a public inter-network, specifically the Internet. Client systems 102, streaming 
program broadcaster 108 and advertisement publisher/server 110 communicate with 
5 each in accordance with standard based messaging and communication protocols, 
such as the Hypertext Transfer Protocol (HTTP) conducted in accordance with the 
Transmission Control Protocol/Internet Protocol (TCP/IP). In alternate embodiments, 
the present invention may be practiced with part or all of the various participants 
being communicatively coupled with others using other equivalent communication 
10 connections and protocols. 

Advertisement Method of the Present Invention 
Figure 2 illustrates an overview of the advertisement method of the present 
invention, in accordance with one embodiment. As illustrated, advertisement module 

15 1 04 first pre-schedules a number of substitute/replacement advertisements for 

playing, block 202. The nature of the advertisements pre-scheduled, and the manner 
in which the advertisements are downloaded and scheduled, under presently 
preferred embodiments will be described more fully below, with references to Fig. 3. 
In various embodiments, to facilitate ease of retrieval for real time responsive 

20 rendering, upon being notified of an advertisement time slot or play window, the 

downloaded advertisements are stored in play queues on a play or time length basis. 
More specifically, in one embodiment, two play length based queues are employed, a 
30 second advertisement queue and a 60 second advertisement queue. That is, for 
the embodiment, the downloaded advertisements are of either 30 seconds or 60 

25 seconds in play length, and upon downloaded, they are queued for playing in the 
respective play queues. 
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The play queues may be implemented using any one of a number of data 
structures known in the art, in particular, those that are conveniently supported by the 
underlying operating system services of client systems 102. 

Thereafter, i.e. upon pre-queuing n numbers of advertisements in the 
5 respective play queues, advertisement module 106 begins to listen for notifications of 
upcoming advertisement time slots in the streaming content or program being 
received and rendered on client system 102. While waiting, advertisement module 
106 continues its process of building up or replenishing its advertisement play queues 
until they are filled. 

10 However, upon being notified of an upcoming advertisement time slot, 

including its time length, advertisement module 106 selects a combination of cached 
advertisements having a total playtime at least equal to the time length of the 
upcoming advertisement time slot, block 206. 

For the earlier described two queues embodiment, advertisement module 106 

15 simply selects the queued advertisements primarily by their play lengths. For 
example, if the slot time length is 0 to 30 seconds, a 30 second advertisement is 
selected; if the slot time length is 31 to 60 seconds, a 60 second advertisement is 
selected. If the slot time length is greater than 60 seconds, a 60 second 
advertisement is selected, and the process is repeated for the residual playing time. 

20 A number of fail-safe techniques may be employed to ensure that adequate 

advertisements would be available. In one embodiment, while an advertisement is 
discarded from the play queues, they are nevertheless kept in the advertisement 
caches (until they are evicted by additional incoming advertisements while the cache 
is full). In another embodiment, advertisement module 106 maintains certain default 

25 advertisements, e.g. its own advertisements, and play them in default, in the event 
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the advertisement cache or queues become empty (except for the special "fall back" 
advertisements). 

Continuing to refer to Fig. 2, upon selecting the appropriate combination of 
advertisements, advertisement module 106 causes the advertisements to be 
rendered. In one embodiment, advertisement module 106 also causes the output of 
streaming program player 104 to be muted or blocked, thereby effectuating the 
desired substitution or replacement, block 208. In one embodiment, if the total play 
length of the selected advertisement is longer than the advertisement time slot's play 
length, advertisement module 106 simply terminates the advertisement rendering at 
the end of the advertisement time slot, thereby refrains from intruding into the 
streaming content or program. 

As alluded to earlier, upon rendering the selected advertisements, for the 
embodiment, the advertisements (except for the default or fail-safe protection ones) 
are discarded from the play queues. In other words, for the embodiment, the 
responsibility for the "scheduling" and "frequency of play" of the advertisements is 
substantially that of the advertisement publisher/server 1 1 0, by virtue of the 
advertisements it provides to client system 102. However, in alternate embodiments, 
the present invention may be extended to have at least part of the "scheduling" and 
"frequency of play" responsibility being distributed to and placed on client systems 
102. 

From block 208, the process returns to block 202, and continues from there as 
earlier described. The process continues cyclically until execution of advertisement 
module 106 is terminated, which may be caused for any reason, and in any one of a 
number of program termination techniques. 
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Pre-Cachinq Advertisements 
Figure 3 illustrates the process of pre-caching advertisements in further 
details, in accordance with one embodiment. As illustrated, for the embodiment, to 
facilitate the tailoring of the delivered advertisements to the consumers of client 
5 system 102, advertisement module 103 generates and provides a profile of the user 
to advertisement publisher/server 110, block 302, allowing advertisement 
publisher/server 1 10 to provide the advertisements based at least in part on the 
information provided in the profile. 

In one embodiment, the profile includes demographic as well as interest 
10 information about the user or consumer. Examples of demographic information are 
age, sex, education and so forth, whereas examples of interest information are rock 
and roll music, sky diving, sailing and so forth. In one embodiment, the profile also 
includes geographic information such as zip code. 

In one embodiment, to the extent that any of these profile information are 
15 available from player 104, advertisement module 106 obtains the information from 
player 104. For the rest of the profile information, at an appropriate time, e.g. 
installation of advertisement module 106, or thereafter periodically, until the user 
provides the information or instructs advertisement module 106 not to seek such 
information again, advertisement module 103 prompts the content/program consumer 
20 user of a client system 1 06 for the earlier mentioned demographic and interest 
information about the consumer. In one embodiment, the prompt also seeks the 
consent of the user in providing the information to advertisement publisher/server 
110. 

In alternate embodiments, advertisement module 106 may also be equipped to 
25 include with the profile interest or other information automatically collected by 

advertisement module 106 itself. Such information may include e.g. the streaming 
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content or program consumed on client system 102 over a period. In fact, 
advertisement module 106 may be equipped to construct the profile strictly based on 
these automatically collected information, and skipping the earlier described 
operation of collecting inputs from the user. 
5 Upon having gathered the profile information, advertisement module 106 

generates a consumer profile based on the information provided/collected, and 
forwards the consumer profile to advertisement publisher/server 110. 

Continuing to refer to Fig. 3, upon furnishing advertisement publisher 110 with 
the user profile, for the embodiment, advertisement module 106 requests 

10 advertisements from advertisement publisher 110, block 304. For the embodiment, it 
is assumed that advertisement publisher 110 instead of returning the selected 
advertisements directly, would advantageously return a list of locations from which 
the selected advertisements may be retrieved instead, thereby allowing 
advertisement module 106 to be able to advantageously control the download to 

15 ensure non-consequential impact on the streaming program being received and 
rendered by player 104 of the client system 102. As alluded to earlier, the present 
invention allows advertisement publisher 110 to provide the advertisements based at 
least in part on the provided profile of the consumer. Such selection may be 
effectuated in any one of a number of weighted or un-weighted techniques known in 

20 the art. Therefore, upon selection, as alluded to earlier, the locations from which the 
advertisements may be retrieved are returned, and received by the requesting client 
system 102, more specifically, advertisement module 106 of the client system 102. 

Then, as alluded to earlier, advertisement module 106 determines an 
appropriate download rate for downloading the advertisements, such that 

25 downloading of the advertisements will not consequentially interfere, or at least not in 
a discernable manner, with the quality of the streaming program, block 308. 
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In one embodiment, to further reduce the amount of download, advertisement 
module 106 maintains a cache of the downloaded advertisements. In the event 
advertisement module 106 is instructed to download and play an advertisement that 
is still being cached, advertisement module 106 retrieves the advertisement from its 
5 local cache instead. 

In one embodiment, the download rate is determined based on the estimated 
available bandwidth of client system 106. In one embodiment, the available 
bandwidth is operationally estimated by incrementally increasing the download rate 
(starting with an arbitrarily small download rate), and for each download rate, 
10 monitors the impact of the download on the streaming program. 

In one embodiment, the impact is gauged using indicators such as the late 
arrival rate, loss and resend rate of the packets associated with the streaming content 
or program. 

For the purpose of this application, late arrival rate means the rate the packets 
1 5 of the streaming content or programs arrive at the client system 1 02 out of order. For 
example, if packet 5 of the streaming program arrives before packet 4 of the 
streaming program, packet 4 of the streaming program is considered a late packet. If 
this occurs once out of every 10 packets, the late arrival rate is 10%. 

Note that late arrival in and of itself does not necessarily has a manifested 
20 degradation in quality to the user, as packets generally arrive sufficiently in advance 
of the time they are needed. Nevertheless, late arrival could be a leading indicator to 
such observable degradation in quality of the streaming program. 

Once determined, advertisement module 106 periodically requests 
advertisement server or servers 110 for the identified advertisements, block 310. 
25 Upon receipt, advertisement module 106 caches the received advertisements, block 
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312. In one embodiment, advertisement module 106 also queues the advertisements 
by their play lengths as earlier described. 

As the bandwidth consumption of any streaming program is non-monotonic, 
and fluctuates over time, thus in the presently preferred embodiment, advertisement 
5 module 1 06 continues to monitor the impact of the advertisement download, and 
adjust the download rate as appropriate to continually ensure the impact of the 
advertisement download on the streaming program will be non-consequential. 

in one embodiment, the bandwidth consumption is regulated employing a pair 
of operational parameters (bit rate, pulse rate). The two parameters represent a 
10 single packet payload, hence an estimate of the bit-pipe usage at a given instant. For 
example, a 30-second file sampled at 8 kbps is approximately 245,760 bits (or 30,720 
bytes) long. To serve this file at 3 kbps, the server would take 80 (245,760 / 3,072) 
seconds. At this rate, to serve payloads of 96 bytes each, the server would have to 
have a pulse rate of 4. (30,720 / (80 x 96)). Thus, by controlling the 'bit-rate' and the 
1 5 'pulse-rate', it is possible to control the fraction of the bit-pipe to be used. 

Therefore, consumption of the bit-pipe may be reduced or "down shifted" by 
employing lower bit rate and pulse rate, or higher pulse rate at the same bit rate; and 
increased or "up shifted" by employing higher bit rate and pulse rate. 

Thus, in one embodiment, the consumption of bit-pipe is controlled as follows: 
20 1 • Choose the initial download rate depending on what stream the user has 

chosen to play (high vs. low) and based on the user bandwidth setting in the player. 

2. Downshift when either the advertisement is not successfully downloaded 
within the expected time or an error is received while buffering the ad. (The 
assumption is that the bit-pipe is too congested to allow this content to be 
25 downloaded at the current rate within the specified time). 
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3. Downshift when a certain number of audio-feed packets are lost (A 
conservative assumption is that the ad-buffering process occupies too much of the 
bandwidth leading to this packet loss). 

4. Downshift when a certain number of audio-feed packets arrive later than 
5 expected (latency is higher than certain threshold usually about ~ 5%). 

5. Downshift when a certain number of audio-feed packets were requested to 
resend by the player. If the player does not receive expected packet in time, it may 
request a packet resent from the server. The advertisement module monitors this 
activity and the downshift is performed when a certain threshold is reached (usually ~ 

10 2%). 

6. Up-shift when an advertisement is successfully cached within the expected 
time and with no audio-feed problems. 

7. Up-shift if a pre-determined number of advertisement are successfully 
cached following a previous downshift. 

15 For the embodiment, while a single reference number 110 is employed to refer 

to advertisement publisher and server, in practice, advertisement publisher and 
server may be the same or different entities. Typically, they are different entities; in 
fact, typically, multiple servers are employed. 

20 Advertisement Plav Tracking 

Referring back to Fig. 2, in one embodiment, advertisement module 106 is 
also equipped to facilitate advertisement publisher 110 in tracking the playing of the 
provided advertisements, thereby allowing more accurate accounting for the playing 
and possibly better assessment on the effectiveness of advertisement campaigns, as 

25 well as better compensation arrangement between the advertisement publisher and 
the advertisers. In one embodiment, at block 208, upon commencement of the 
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playing of an advertisement, advertisement module 106 sends a commencement 
message notifying advertisement publisher 110 of the commencement of play. In like 
manner, upon completion of the playing of the advertisement, advertisement module 
106 sends an end-of-play message notifying advertisement publisher 110 play of the 
5 advertisement has ended, thereby allowing advertisement publisher 1 1 0 to more 
accurately track the total play time of each provided advertisement, on each 
consumer client system 102. 

The above referenced "commencement" and "end-of-play" messages may be 
implemented using any number of predetermined message formats, which are well 
1 0 within the ability of those skilled in the art to define, accordingly will not be further 
described. As alluded to earlier, in one embodiment, these messages are HTTP 
messages transmitted in accordance with the TCP/IP protocol. 

Example Computer System 

15 Figure 4 illustrates an example computer system suitable for use to practice 

the present invention in accordance with one embodiment. As shown, computer 
system 400 includes one or more processors 402 and system memory 404. 
Additionally, computer system 400 includes mass storage devices 406 (such as 
diskette, hard drive, CDROM, RAM, DVD and so forth), general purpose 

20 input/output interface 408 (for interfacing input/output devices such as keyboard, 
cursor control and so forth) and communication interfaces 410 (such as network 
interface cards, modems and so forth). In accordance with the claimed invention, a 
storage medium may include a mass storage device, system memory or any device 
where information may be stored in electrical, optical and/or other encoded form. 

25 The elements 402-410 are coupled with each other via system bus 412, which 
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represents one or more buses. In the case of multiple buses, they are bridged by 
one or more bus bridges (not shown). 

Each of these elements 402 - 410 performs its conventional functions known 
in the art. In particular, communication interface 410 includes associated device 
drivers to facilitate communications in accordance with the communication protocol 
relied by streaming program player 104 and advertisement module 106. Further, 
system memory 404 and mass storage 406 are employed to store a working copy 
and a permanent copy of the programming instructions implementing the earlier 
described digital content recovery module and the rendering modules incorporated 
with the teachings of the present invention. The permanent copy of the 
programming instructions may be loaded into mass storage 406 in the factory, or in 
the field, through a distribution medium (not shown) or through communication 
interface 410 (from a distribution server (not shown). 

The constitution of these elements 402-412 are known, and accordingly will 
not be further described. 

Conclusion and Epilog 
Thus, it can be seen from the above description, a method and apparatus for 
advertisement delivery for streaming program has been described. While the present 
invention has been described in terms of the above-illustrated embodiments, those 
skilled in the art will recognize that the invention is not limited to the embodiments 
described. The present invention can be practiced with modification and alteration 
within the spirit and scope of the appended claims. Thus, the description is to be 
regarded as illustrative instead of restrictive on the present invention. 
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